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ABSTRACT 

The project described offers an approach to providing 
occupational skills to socially and educationally handicapped youth, 
specifically the skills necessary for a service station attendant in 
dri/eway salesmanship and auto care. The 10-page evaluation report 
presents project goals and objectives vith evaluation data 
(represented graphically) and e valuator's comments, and proposed 
modifications and additions for the following year. The six tests 
used in evaluating the learners* acquisition of skills consonent with 
the project's oiJjectives are appended. (A J) 
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IMTRODUCTION 



Thf$ evaluation report Is prepared pursuant to a review of existing student data, 
study of the 1972- 1973 E.S.E.A. Tltle lll propoool , and discussions \^/ith the 
project staff. 

Since the project did not get officially underway until the middle of the funding 
period end the Evalur.tor v;a5 not Involved until the suntner of 1973* evaluation 
data are somewhat incomplete. It Is believed, however^ that sufficient data do 
exist to indicate a pro.-nislng future for this effort. 

EVALUATION RESULTS 



The follov;1ng evaluation data arc orcanlzed according to the objectives specified 
Jn the 1972-1973 E.S.E.A. Title ill proposal and preso.nt the facts available as of 
the date of this report. Before presenting these data, hov/cver, two general 
Gormicnts should be niiide. First, although- the original proposal refers to delinquent 
bo;^, three girls have been Involved In the training; and one of these girls 
successfully graduated from the program. Second, the proposal typically calls for 
evaluation data to be obtained four and ten w^^eks after student enrollipent in the 
progn-m. In rc^^lftyt the students v/ere rsdvsnced on the basis of their individual 

, . , r. . ,. ... «. - . .1 - J ^ - ^ .1 t. . - *. U » • .. A. ^ - « ^ -^^-^ 1 /, ^ ^ *. } r* - t»f 

conducted dur ing the last v^eek of tite students' training rather than four or ten 
weeks after enrollment. / 

Evaluation data and comments relevant to each project goo) <?nd objective (which sre 
listed verbatim) follow. 

Pro ject Goa l; T o Tr a i n Adolesc ent Del lnqu f^.nt Boys 
in the Basic Procedures ot Driveway Saicsmanship . 



O bjective I : Each student will operate v/lth 100? accuracy a cash register within 
h weeks after enrollment as i7>easurcri by teacher prepared test 
consisting of )0 money changing problems. 

Test I was developed by the project staff to measure achievement of this objective 
(sec Appendix). The results of this test for the six graduates of the program are 
presented in Figure 1 on the next page. 

Although only tv;o of the students reached the desired criterion level of 1005;, an 
examination of. Test I reveals that this test measured much more than Just ''cash 
register operation'^ For example, to successfully answer Item 1, the student 
must (a) correctly read the problem, (b) detcrnunc the cost of a quart of oil and 
the cost of a quart of windshield vdpcr solvent, (c) determine the correct amount 
of tax, and (d) select the correct denomination of change. In addition to operating 
the register correctly. ThuSj the mean of S2Z correct responses appears adequate. 
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Obj ect t v^e 2 : 



Each student will operate with 100^ accuracy a credit card imprinter 
U'lthin ^1 ivcslcs after enronment meaisurcd by teacher prepared 
test consisting of 10 credit card problems. 



Test II v/as developed to measure achievement of this objective. Tost results 
for the six graduates are shov/n in Figure 2. 

As with the first test. Test !l measures more than just operating a credit card 
Imprinter, and the data should be interpreted in this light. Again, In the 
opinion of the Evaluator, the mean percent of correct responses is quite satis- 
factory. 
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Objective 3: 



Objective k\ 



Each student operate with 95X accuracy a gasoline pump within 

k weeks after enrollment as measured by 1.0 real teacher supervised 
situations. 

Each student v/I 11 be able to check oil level and make necessary 
adjustments with 100?^ t^ccKXK'i^c^ within h weeks after enrollment as 
measured by 10 teacher supervised real situations. 



Objective 5 ; Each student will be able to check radiator fluids and make necessary 
adjustments with lOOS c'jccuracy within h weeks after enrollment as 
measured by 10 teacher supervised real situations. 



Oblectlve 8: 



Each student will be able to display social skills required for 
salesmanship within h weeks after enrollment as measured by teacher 
devised simulritcd situcitlons requiring use of these skills and real 
situations utlll2:ing teacher supervision. ■;. 

Test V was devised to measure these objectives. The Instructor observed the students 
In actual selling situations and converted these observations Into numerical scores 
O of the percent of correct responses. These data are shown in Figure 3. 
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Figure 3. Percent of Correct Responses on test V 



V/hlle Test V was somewhat subjective ?n nature, many aspects of the students' 
performances were recorded, and the resulting scores were quite high. 



Oblectlve 6: 



Each student v/i 11 be able to change v/indshlcld wiper blades with 
100!S accuracy v/lthin h weeks after enrollment as measured by 10 
teacher supervised real situations* 



No actual data exist relative to this objective; however, the Instructor stated th 
most of the students had experience In changing v^indshlcld wiper blades. 



Obj ective 7 : 



Each student will be able to recall and identify with 100^ accuracy 
within h weeks after enrollment the vital components of the auto- 
n)obMe as measured by teacher devised test .cons istlng of student 
Identification from check list of vital components. 



Test IV v/as developed by the instructor as a means of mca'^urlng this objective. 
Scores for Test IV arc shown In Elgurc 
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Figure k. Percent of Correct Responses on Test IV 



Aga?n, It must be noted that this test measured more than that strictly called for 
by the objective; ue.» not only did the student have to Ident i f y each component, 
he had to note Its funct ion. Consequently, ft Is again felt that the overall 
percentage of 5)2!S correct is quite satisfactory* 



P roje rt Go al : To Train Adolescent Delinquent Boys 
In tlic Uas ic Skills Kequired tor Minor Auto Care Service 



Oblcctive 1 : 



Ecich student will be able to channe oil and oil filter with 100^ 
accuracy within 10 >vceks after enrollment as measured by teacher 
evaluation in actual situations. 



Oblcctlve 2: 



Each student v/ijl be able to perform basic lubrication of auto with 
1005b accuracy within 10 weeks after enroUncnt as measured by teacher 
evaluation in actual situations. 



Oblcctlve 3: 



Each student v/Ill be able to change and repair tires v/Ith 100% 
accuracy v/ithin 10 weeks after enroMment as measured by teacher 
evaluation in actual situations. 



Test VI addresses Itself to measuring conceptual knowledge relevant to these 
objectives. In addition, the instructor has stated that he observed all of the 
students successfully perform the tasks specified in these objectives. The results 
of Test VI are shown in Figure It should be noted that Test VI covers 
considerably more than the topics mentioned in Objectives I, 2, and 3« 
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Objective h\ 



Each, student will be able to replace the fan belt v/lth 100^ accuracy 
within 10 weeks after enroUment as measured by teacher evaluation In 
actual si tuatlons. 



V/hile documentation is not available, the Instructor stated that he has observed 
each of tl^e graduates correctly replace a fan belt. 



Objective 5: 



Each student will be able to replace the air filter and check the 
carburetion with 100^; accuracy within [unspecified] weeks after 
enrollment as measured by teacher evaluation in actual situations. 



The Instructor has stated that each of tlie students had experience fn changing air 
^ Jtcrs. Additionally, it should be noted that Question 16 on Test VI asks how to 
ERJCl I when an air filter is bad. it is the opinion of the instructor that the 
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second part of this objective, I.e., "check the carburetlon*', In an Inapproprlotc 
task since this Is a service wfiich is seldom performed on modern engines. 

Objective 6 : Each student will be able to repair the cooling system, thermostat 

control with 100? accuracy within [unspecified] weeks after enrollment 
as measured by teacher evaluation in actual situations. 

Test ill Is entirely concerned with the cooling and emission control systems of 
automobiles. The results of this test are shown in Figure 6, Each of the 
students also was observed by the instructor while replacing or repairing a 
thenTK)5tat control. 




Students 

Figure 6. Percent of Correct Responses on Test lt( 



Objective 7 : Each student will be able to replace spark plugs v/ith 100?; accuracy 

within 10 weeks after enrollment as measured by teacher evaluation In 
actual situations. 

Objective 8; Each student will be able to replace points with 100^; accuracy within 
[unspecified] v/ecks after enrollment as measured by teacher evaluation 
In cictual situations. 
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Objective 9 ; Each r.tudcnt will be able to pcrfonn a minor tunc-^up (engine timing) 
with 100^ accuracy within [unspecified] weeks after enrollment as 
measured by teacher evaluation In actu^jl situations. 

These three objectives are concerned with performing minor engine tune-ups. Although 
precise data relative to achievement of these objectives are not available, it Is 
the Instructor's opinion that five out of the six graduates could adequately 
perfom a minor tune-up. 

Objective 10 : Ecch student will be able to replace the exhaust system (mufflers, 
tail pipe, etc.) with 100^ accuracy wi thin [unspecified] weeks 
after enrollment as measured by teacher evaluation In actual 
situation. 

Five out of the six graduates successfully replaced exhaust system components as 
Judged by the instructor. The only student not given experience In these tasks was 
the female. The rationale was that she did not possess the strength required to 
perform these functions. 



Project Goal: To Trr-nin Adolescent Oelinauent Boys in the Basic Skills 
Recju! red for Au t o.-^o t i ve' t i cct i rca T System and Brake arid Wheel Alionnient 
Service ^ 

/ 

Only very recently has the first student entered thSs phase of the troJnJr.g; there- 
fore, no evaluation data are available. 



Project Goal: To Train Adolescent Deling uent Boys in the Mnnaqcment Aspects 
of ^pcra t ki q a Scrvi ce Stat i on^^ Autc^^ £?SJLSSS21'S^JL 

To date, no students have entered this phase; consequently, no evaluation data 
are available. 
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Lead lnt.^vitobly to Prison 

Objective 1 : Each student completing the program will within 6 months after 

release, obtain employment in the auto care maintenance field and 
Q maintain employment not necessarily in this field, for at least an 

>!r]" . ^ additional 6 months. 



since the services of an Independent project Evaluator v/erc not contracted for 
until the surnrner of 1973> ^ questionnaire has not yet been developed to obtain 
Inforrnatton relotive to this objective. However, the lni;tructor knows that four 
of the graduates currently are working In service stations. Of the remaining 
two graduates, one Is too young to be employed, and the Instructor Is uncertain 
about the cmployrnant situation of the otiier. 

Obj ective 2 ; Each student completing the progrcm will abstain from serious 
law violation for at least 1 year after release. 

Data relative to this objective currently are not available. 



G r.NI^RAL EVALUATIOU COMHEUT S 

Although a strict interpretation of the project goals and objectives would lead 
one to state that' only a few of the objectives actually were achieved. It Is the 
opinion of the Evaluator that a more lenient Interpretation siiouid be made. 
Three bases for this opinion exist. First, most of the objectives call for ]00Z 
achievement by ]00% of the students involved — a criterion level which fs nearly 
isnpobslble to achieve. Second, the evaluation Instruments developed by the 
Instructor are considerably broader In scope than required by the objectives. 
Although the Evalui^tor uelleves — as docs the Instructor — that this broader 
scope more realistically covers the range of skills required to be successful 
service station employees, it is obvious that student performances demanded by the 
wCSc t tcrfiS are 3 igrii f iCant ly »T:orc complex than those rocjutred by the objectives} 
and, therefore, the resulting scores shjDuki be interpreted in light of these 
differences. Finally, the project did not have the services of an Evaluator 
throughout essentially its entire first year; and, thus, some evaluation Instruments 
were not developed. 



PROPOSED MOD IF I CAT [QMS AfJD ADD ITIONS 
FOR fnr 1973-197'i EVALUATiO:^ 



Several modifications and additions are proposed for the 1973-197^* evaluation 
effort. Each of these is discussed separately below. 

Hodlfy Existing Objectives 

It Is recommended that the existing learner objectives for project goals l and 
2> I.e., modules 1 and 2, be reviev/ed and revised. Nearly all of these objectives 
set unrealistic criteria levels; e.g., 100^ of the students v/Ml score lOO^i;; and 
there Is at least one case where the content of an objective Is Inappropriate. 
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Maintain \/r?tton Documontnt ion of Student Pronross 

Inasmuch as several of the evaluation techniques call for instructor observation 
of student pcrfornvmce, it Is recommended that a simple data collection fonn be 
developed and maintained. This form v/ould be used to record the date on which 
the Instructor observes a student correctly performing one of the specified 
tasks, e.g., changing an air filter. 



Maintain l/rlttcn Documen t ation Repardlng Student V/ork Attitude Behaviors 

Again, a simple data collection form will be developed and maintained for recording 
student work attitude behaviors such as punctuality and attendance. 

Obtain Pol low-Up Data On Graduates 

Inasmuch as one of the major goals of the effort Is to reduce recidivism among 
youth v/hd have participated In the program, effort will be devoted to developing a 
foliov/-up lnstrurn::nt to gathier data on the graduates of the project. Specific 
Infon^ation to be obtained from such an Instrument v/M l be jointly decided by the 
Project Director and the tvaiuator; however, it Is anticipated that data will be 
gathered relative to: 

0 the current occupational or educational status of each youth, ^ 

c the work record of each youth, 

o the frequency and type of legal Infractions (if any) committed by each 
youth, 

e the Improvement or expansion of the program (the graduates wIU be asked 
to make specific recornincndat loni>) . 



Determin e Averac i e Cost Per Graduate 

The project and, station financial records v/lll be analysed to determine average 
coot p::r graduate. This will be done by subtracting project Income from project 
expenses and then dividing by the number of graduates. Such cost data should be 
very relevant to determining whether the program should b^ replicated and/or 
expanded. 

De velop Additional Learner Objectives ^ 

Now that a student has entered training on goal 3 , module 3» It Is imperative 
that learner objectives for tfils goal be establisticd In order that proper 
evuluatlon can be conducted. Similarly, If It Is anticipated that students will 
,^^ ter training on module ^ during 1973-197^, learner objectives must be specified. 



APPENDIX 
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Date 



TEST I 



DIrccttons - The following questions will be ansv/ered as though they were actual 
customer situations* The purchase v/i 11 be rung up on the cash register using the 
proper keys for each purchase. The change due the customer will be v/ritten out in 
the proper denani nations. For example, if a customer buys a thirteen cent item 
and gives you a quarter^ his change would be 12c, written out as 2 pennies and a 
dime* Correct change, by the way, doesn't mean just the right amount, but also the 
correct denominations. Any questions you have concerning this test will be answered. 

1. A customer gets $3.25 worth of gasoline, needed a quart of oil (ARCO Supreme) 
and a quart of windshield wiper solvent* 

A.) How much tax do you charge for this purchase? 

B») Hov/ (guch is the total purchase? 

C,) If the customer gives you a $20 bill, what Is his correct change? 



2» A customer comes In for an oil change and a lube job. His car requires a 

Hastings 115 oil filter ($^U29 each) and he wants 5 quarts of ARCO Plus oil (green 
cans). 

A. ) How much should his bill be if the lube costs $K25? 

B, ) V/hat Is his correct change from a $10*00 bill? - 

3» A customer comes In with a flat tire and you determine that It can be plugged for 
a price of $1.50. In addition, he asks you to check his spare and you find that 
It has a defective valve stem, v/hich costs $1#75 to replace. 

A. ) V/hat is the total price for these things? 

B. ) V/hat Vs his correct change from $^$.00? ; 

h. A customer comes In with a dead battery and you sell him a new one for our $17.77 
special price, 

A. ) How much Is his bill? 

# 

B, ) How much tax do you charge him? ______ 

ERJC:.) V/iiat Is his correct change from a $20 bill? 



TEST I (continued) Page 2 Name 



5. A customer on the drive coxos In and buys $3.33 worh of gas and gives you a 
$5 bill, 

A.) V/hat Is his correct change? 



6. A wustcmer gets a tune^up. The spark plugs cost $12,75, the rotor cap costs 
$^•55, the rotor cocts $2,35» the breaker points cost $3-25, and the condenser 
costs $K75* Vou charge him $10*00 labor and add a quart of AIICO (red cons) to 
his engine. 

A. ) Hov/ fr,uch sclcs tax should you charge him? ^ ^ 

B. ) Vfnat Is his total bill? 



C.) Vfnat Is his correct change from $A0.00? 



7. A custorvrsr ccTjr^s. In and buys a can of STP ($I*50) and a quart of windshield wiper 
solvent* He gives ycu $3-00. 

A.) Ha*/ much should you charge him? 

/ 

8. A custCTTfcr co^nes In for a grease job? If you charge him $2,25 for It, how much 
wll! his total bin be? 



A.) If he gives you $3.00, v/hat is his correct change? 

9. A^us terrier corses In with a broken fan belt. His engine has also overheated and 
he has lost 2 gallons of antifreeze. You replace the fanbelt, which costs $^.35» 
charge hha $2.0G Irjbor to put It on, and put 2 gallons of antifreeze In his 
radiator at $2.25 ^ gallon. 

A. ) HcTr/ Ruch sales tax should he pay? • 

B. ) Vrnat Is hU total bill? 

C. ) vrnat Is his correct change from a $20 bill? • 



10. A custorrver has, 2 tires balanced at $2.00 per tire and buys $1.00 v^brth of gas. 

A. ) HoT/f rr.uch sales tax should he pay? _____ ' 

B. ) What Is his total bill? 



Name 

Date 

TEST II 

Directions - The following Items will be written up on credit card slips end run 
through the Imprinter as though they wore csctucjl purchases by customers. A credit 
card and signature are not neccssat*y In this tost and the space for the license 
number of the customer's car may also be omitted, but the rest of the card sf^ould be 
filled out properly. Turn in onl y the tissue copy of the card and discard the rest. 
The tissue copy Is the one that you give the customer. 

1. ) Two tires balanced at $2.00 per tire and one dollar's worth of regular gas 

2. ) A fcnbelt which costs $^i.35r $2.00 labor for putting the bonbalt on, end 2 

gallons of antifreeze at $2.25 per gallon ^ 

3. ) A $2.25 grease Job . 

k.) A can of STP at $1.25 per can, a quart of wlndshlle wiper solvent at $.75 per 
can 

5. ) Eight J-U-J spark plugs for $12. 75^ a rotor cap for $^.95r a rotor for $2.35r 

breaker points for $3-25, a condenser for $l.75> $10.00 labor for the tune-up, 
and a quart of ARCO {red cans) 

6. ) $3*33 v;orth of Arco Supreme 

7. ) A Delco Energlzer battery at $17.77 

8. ) Plug a tire for $1.50 and replace a valve stern for $1.75 

S.) A Hastings li;? oil filter for $h.2S, 5 quarts of ARCO plus oil 
lOo) $3.25 h"orth of rcgu]Qr gasoline, q qasfrt of ARCO Supreme oil and a quart of ' 
windshield wiper solvent 



Name 

^ Date 

• 1 -I, 11 I, ■ I L 

• TEST til 

Dfrcctfons - The followfng questions on the automotive cooling system are to be 
answered 'el ther true or false. 



!•) T he cooling system of an average automobile handles enough heat to keep a 

five room house warm In zero degree weather. 

2. ) Vn^n your car Is overheating, such as In a traffic Jam or on a hot day, you 

should remove the radiator cap and pour In plenty of cold water. 

3. *) The Pressure Radiator Cap permits the engine to run hotter. 

k.) The entire cooling system must be checked In the spring and the fall. 

5. ) B efore installing a new Radiator Pressure Cap, you must test the system v/lth 

a Pressure Tester. 

6. ) If a car shows a constant coolant loss, you check the Pressure Cap and the 

entire cooling system with a Pressure Tester. 

?•). The lever-vent type radiator cap can help to prevent burns and scalds from 

ope Ung an overheated radiator. 

8. ) R unning a car with the Pressure Cap In the Release position will prevent 

water loss and overheating. . y ' 

9. ) I'he Thermostat Is to prevent overcoollng and overheating of the engine. 

10. ) T he Thermostat helps the engine to warm up, quickly. 

11. ) ' A n Emission Control gas cap is similar to a Radiator Pressure Cap. 

12. ) Y ou cannot use a regular vented gas cap on a 1971 or later car v/hlch 

originally had an Emlslon Control Gas Cap. 

IJ.) Y ou can use an Emission Control Gas Cap on pre-1971 cars. 

\h.) L ocking gas caps sometimes give your customers better gas mileage. 

15. ) ; on filler caps having filter elements must be cleaned or replaced 

regularly. 

16. ) On cars built after \S6h, the oil filler cap Is an essential part. 



Name 
Date 



TEST IV 

pire ctfons ^ On this test, you wfll be asked to locate and Identify all of the basic 
automotive components listed below and then, on your own, tell what tl^ey are for. 



item 

I. Carburetor 
2/ Air Cleaner 
3. Oil Filter 
Gas Filter 

5. PCV Valve 

6. Starter 

7. Battery (pos. & neg.) 

8. on Dfp Stick 

. 5. Transmfssfon Dfp Stick 

t 

10. Voltage Regulator 
IK Alternator-Generator 

12. Coll 

13. Distributor 
\h. Points 



Identification 



Function of the part 



Condenser 

ERIC 



TEST IV (continued) Page 2 

it psn Identtf {cotton 

16. Spark Plugs 

17. Pxcidlator 

18. Thermostat 

19. Power Steering Pump 

20. Distributor Rotor 

21. Brake Fluid Reservoir 

22. Transmission 

23. Muffler and Tailpipe 
2A. ' / 

25. Brake Drums 

26. Brake Shoes 

27. Power Steering Dip Stick 

28. Fuel Pump 

29. V/Ipcr Solvent Reservoir 

30. Fan ^ 
31 • V/ater Pump 



Name 



Function of the part 



Name ^ 
Function of the part 

33. Timing Mark 

3h. on Filler Cap 

35. Radlotor Cap 

36. Universal Joints 



TEST IV (continued) Page 3 

< " • 

Item Identification 
32. Fuse Panel 



Name ' 
Date ' 

TEST V 

Directions - Each student will service ten customers on the drive In the normal 
fashion* The manner In which this Is done v/Ml be observed, watching for such 
things as the accuracy of pumping, courtesy to the customer, how well the windows 
and headlights arc cleaned. If the oil Is checked, etc* A short critique of the 
student's performance will be written below for each of the ten customers* 
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TEST VI 

Find the answer to the following question In the parts catalogs, 

1.) Find the oil filter end air filter numbers for a I969 Ford 302 cu. In. engine, 
with a 2"barrel carburetor, 

on filter number - List price - Dealer price * 

Air filter number - List price - Dealer price - 



2. 



ft. 

5- 
6. 

7. 
8. 

10. 



How tight should a new oil filter be tightened? 

How many quarts' of oil do most American cars require when changing both the oil 
and the f 1 Iter? 

/ 

\^at are the tK-o methods of rcpa2irtng a tire? 

\v'hat Is the purpose of a gasket? 

How can you tell if a belt needs replacing? 

V/hat does a muffler hanger do? 

Ho\^ do you time an engine? 

Hov! many spark plugs does an 8-cyllnder car require? 
What are vehicle specifications? 



12.) \'*'hat does a fuel filter do? 

O V Approximately how raany qallons of fuel does the average /^^^erlcan car hold? 

FRir ^ ~ 



TEST VI (contjiuicd) 
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Name 



lA.) V/l-»at Is a wiper blade and how do you know if one Is bad? 



15.) Find the part numbers and the' list prices for a complete exhaust system on 
a 1969 Chevrolet 6 cylinder. 



16.) How can you tell If the air filter Is bad? 



17.) I'/hat does It mean to rotate tires? l/hy Is this done? 



)8*) \'lhot l^s a Hydronicter and v^hat does it do? 



13.) Vi'hy would you use a torque v/rench? Name several places on a car where one might 



20.) \vhar. precautions should you observe when chcirylny a battery? 



ERIC 



